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[57] ABSTRACT 

In a system that transmits packets containing timestamps 
and information from a transmission site to a reception site 
at a transmission bit rate the packets may experience jitter, 
Le. variable delay, during transmission. In such a case, the 
packets are temporally shifted relative to the timestamps and 
to other packets. Where the timestamp values are inserted 
into selected packets prior to transmission and that times- 
tamp represent the value of the transmission site clock, the 
method and apparatus of the present invention substantially 
removes the jitter and adjusts the timestamp values prior to 
reception of the packets at the reception site. The present 
invention achieves this goal by receiving the packets at an 
intermediate site that has a local clock operates at a nominal 
frequency substantially equal to the nominal frequency of 
the transmission site clock and uses mat clock as a jitter-free 
clock to correct the packets. The packets are stored in a 
buffer at the intermediate site and output from the buffer at 
a controlled rate to maintain a substantially constant average 
transit time of packets through the buffer. Before the packets 
are output for reception at the reception site the timestamps 
of selected packets are modified to reflect the new temporal 
relationship between packets due to the controlled rate of 
output from the intermediate site. 

10 Claims, 9 Drawing Sheets 
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METHOD AND APPARATUS FOR 
REMOVING JITTER AND CORRECTING 
TIMESTAMPS IN A PACKET STREAM 

FIELD OF THE INVENTION 

The present invention relates to digital transmission 
systems, and more particularly, to a method and apparatus 
for removing jitter from transmitted packets subjected to 
uncorrected variable delays, and for correcting timestamps 
in selected packets to accurately reflect the temporal location 
of selected packets relative to other packets. 

BACKGROUND OF THE INVENTION 

The International Organization for Standardization (ISO) 
adopted a standard protocol for combining one or more 
"elementary streams" of coded video, audio or other data 
into a single bitstream suitable for transmission. The 
standard, hereinafter referred to as the "MPEG-2 Systems" 
standard, is described in detail in the MPEG-2 Systems 
Committee Draft (ISO/EC JTC1/SC29/WG11 N0801, 
November, 1994) [hereinafter "MPEG-2 Systems Commit- 
tee Draft"], which is hereby incorporated by reference. An 
overview of the MPEG-2 Systems standard is provided in 
Wasilewski, The MPEG-2 Systems Specification; Blueprint 
for Network interoperability (Jan. 3, 1994), which is also 
hereby incorporated by reference. The MPEG-2 Systems 
standard provides a syntax and set of semantic rules far the 
construction of bitstreams containing a multiplexed combi- 
nation of one or more ••programs." A •'program" is composed 
of one or more related elementary streams. An "elementary 
stream" is the coded representation of a single video, audio 
or other data stream that shares the common timebase of the 
program of which it is a member. For example, in the context 
of a subscription television system, a program may comprise 
a network television broadcast consisting of two elementary 
streams: a video stream and an audio stream. 

As development of the MPEG-2 Systems standard 
progressed, a two-level packet-based multiplexing scheme 
emerged. At the first level, each elementary stream to be 
transmitted, Le,, the coded data for one video, audio or other 
data stream, is packetized to form a Packetized Elementary 
Stream (PES). Each PES packet in a given Packetized 
Elementary Stream consists of a PES packet header fol- 
lowed by a variable length payload containing the coded 
data of that elementary stream. The Packetized Elementary 
Stream structure provides a mechanism far packaging sub- 
parts of a longer elementary stream into consecutive packets 
along with associated indicators and overhead information 
used to synchronize the presentation of that elementary 
stream with other, related elementary streams (e.g., elemen- 
tary streams of the same program). 

At the second level, one or more Packetized Elementary 
Streams may be further segmented or 'packetized" to facili- 
tate combining those streams into a single bitstream for 
transmission over some medium. Ultimately, two different 
second level protocols for combining one or more Pack- 
etized Elementary Streams into a single bitstream emerged: 
1) the Program Stream (PS) protocol and 2) the Transport 
Stream protocol Both stream protocols are packet-based 
and fall into the category of transport layer entities, as 
defined by the ISO Open System Interconnection (OSI) 
reference model. Program Streams utilize variable-length 
packets and are intended for error-free environments in 
which software parsing is desired. Program Stream packets 
are generally relatively large (IK to 2K bytes). Transport 
Streams utilize fixed length packets and are intended far 
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transmission in noisy or errored environments. Each Trans- 
port Stream packet comprises a header portion and a payload 
portion. Transport Stream packets have a relatively short 
length of 188 bytes and include features for enhanced error 
5 resiliency and packet loss detection. The remaining back- 
ground discussion will focus primarily on the MPEG-2 
Transport Stream protocol Each group of Transport Stream 
packets that contain the same elementary stream data are 
assigned the same unique Packet ID (PID). For example, the 

10 elementary stream containing the coded video data for a 
network television program may be assigned a PID of "10"; 
the elementary stream containing the associated audio data 
for that program may be assigned a PID of "23," and so on. 
As finally adopted, the Transport Stream protocol pro- 

X5 vides a standard format (Le., syntax and set of semantic 
rules) for combining one or more Packetized Elementary 
Streams into a single Transport Stream that may then be 
transmitted over some medium. FIG. 1 graphically illus- 
trates the generation of an MPEG-2 Transport Stream from 

20 a plurality of Packetized Elementary Streams. As iEustrated, 
the individual packets of each Packetized Elementary 
Stream are segmented and inserted into the payload sections 
of successive Transport Packets. For example, as illustrated 
in FIG. 1, one of the PES packets 10 of the Packetized 

23 Elementary Stream containing the coded video of elemen- 
tary stream "Video 1" is segmented and inserted into the 
payload sections of consecutive Transport Packets, e.g. 12 
and 14. Every Transport Packet has a header, e.g., header 16 
of Transport Packet 12, and the header of each Transport 

30 Packet contains the FID associated with the Packetized 
Elementary Stream carried in that Transport Packet In the 
example illustrated in FIG. 1, the Packetized Elementary 
Stream carrying the coded video of elementary stream 
"Video r has been assigned a PTD of M 10, n and therefore, 

35 the header of each Transport Packet 12, 14 carrying data 
from that Packetized Elementary Stream will contain a FID 
value pf "10." Similarly, the headers of each Transport 
Packet 18, 20 carrying Packetized Elementary Stream data 
far elementary stream "Audio 1" will contain the FID 

40 assigned to that elementary stream, which in the example 
shown is "23." 

The Transport Packets formed from each Packetized 
Elementary Stream are then multiplexed to farm a single 
outgoing bitstream or Transport Stream, Thus, a Transport 

45 Stream comprises a continuous sequence of Transport 
Packets, each of which may carry data from one of a 
plurality of Packetized Elementary Streams. At a decoder 
location, a given Packetized Elementary Stream can be 
recovered from the incoming Transport Stream by simply 

so extracting every toroming packet whose header contains the 
PTD assigned to that Packetized Elementary Stream. A group 
of related Packetized Elementary Streams (eg. audio, video 
etc) can be extracted to reproduce a complete program. 
As the MPEG-2 Systems standard developed, the 

55 MPEG-2 Systems Committee further decided that segmen- 
tation of each Packetized Elementary Stream into a respec- 
tive sequence of Transport Packets is to be carried out by an 
encoder at the transmission site employing a common sys- 
tem clock that operates at a nominal frequency of 27.0 MHz. 

60 Decoders for receiving and presenting a selected program 
(Le., a set of related elementary streams) will therefore need 
a corresponding system clock whose frequency of operation 
and absolute instantaneous value match those of the encoder. 
However, in practice, a decoder's free-running system clock 

65 frequency will rarely, if ever, match the encoder's system 
clock frequency exactly, and therefore, some method for 
synchronizing the decoder system clock with the encoder 
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system clock is required As the MPEG-2 Systems standard A and B, carries the Packetized Elementary Stream data of 
developed, participants of the MPEG-2 Systems Committee an exemplary video elementary stream; **Video 3." The other 
suggested that synchronization of a decoder's system clock sequence of Transport Packets, e.g. Packets C and D, carries 
with me encoder's system clock (sometimes also referred to the Packetized Elementary Stream data of an exemplary 
hereinafter as "clock recovery") be achieved through the use 5 audio elementary stream, "Audio 7." As further illustrated, 
of timestamps, referred to in the MPEG-2 Systems Com- Transport Packets A and B in the sequence of packets for 
raittee Draft as Program Clock References. A Program "Video 3 n contain Program Clock Reference values, PCR A 
Clock Reference (PCR) is an actual "snapshot" of a counter and PCR^ respectively. As explained above, each of the 
connected to the encoder's system clock. According to the timestamps is a "snapshot** of the encoder system clock at 
technique adopted, for each program carried in a given 1Q the time the PCR was inserted into its respective Transport 
Transport Stream, PCR's must be generated at least once Packet of the sequence. Accordingly, a series of PCRs 
every 100 ms and inserted into the Transport Packets car- carried in the sequence of Transport Packets formed from a 
rying one of the elementary streams that make-up that particular Packetized Elementary Stream reflect the actual 
program. For example, as illustrated in FIG. 1, PCRs 24 and timebase of the single program of which mat Packetized 
26 have been inserted into Transport Packets 12 and 14, 1S Elementary Stream is a member, 
which carry Packetized Elementary Stream data for the Still referring to FIG. 2, assume that Transport Packets A, 
video elementary stream, "Video 1," of "Program 1." B and C of the respective Transport Packet sequences for 
Similarly, PCRs, eg. PCR 28, have been inserted into the "Video 3" and "Audio T exit the Transport Stream multi- 
Transport Packets, e.g. packet 32, carrying Packetized plexer in the order A - C - B, as illustrated. In such a case, 
Elementary Stream data for the video elementary stream, ^ Transport Packet B has been delayed relative to Transport 
"Video 21," of "Program 21." Packet A by an amount, AT M . Consequently, the original 

As mentioned, for a given program, PCRs must be timestamp, PCRB, in Transport Packet B will no longer 

generated and inserted into the sequence of Transport Pack- accurately reflect its relation in time to Transport Packet A. 

ets carrying one of the elementary streams of that program To compensate for such multiplexing delays or other vari- 

at least once every 100 ms. Each PCR is an actual snapshot ^ able delays, the MPEG-2 Systems Committee suggested that 

of a counter connected to the encoder system clock at the the PCR of any Transport Packet that experiences such a 

time the PCR was inserted into its respective Transport delay be adjusted to account for the delay. As noted above, 

Packet, and therefore, the original PCRs inserted into the however, in situations where all packets experience a same 

Transport Packets of a given program reflect the true time- constant delay, no adjustment of the PCRs is necessary, 

base of that program. With such a timestamp approach, each ^ However, it is unlikely in most situations that all packets wfll 

program may have its own independent timebase, and experience an exactly constant delay, 

therefore, there is no need to synchronize the timebases of The adjustment of a PCR to compensate for a variable 

different programs prior to multiplexing. delay is illustrated in FIG. 2. As shown, the original PCR of 

Although the PCRs in the sequence of Transport Packets Transport Packet B has been replaced with an adjusted 

carrying Packetized Elementary Stream data for a given 35 value, PCR*. The adjusted timestamp value, PCR B \ is 

program represent the true timebase of the program prior to obtained by adding the value of the delay, AT^ to the 

any multiplexing stages, the MPEG-2 Systems Committee original timestamp value, PCR*. Thus, PCR l ,'=PCR i ,'44T Ar 

realized that as the Transport Packets for each elementary At a reception site, a decoder can be used to select one of 

stream reach the Transport Stream multiplexer 22, certain the programs carried in an incoming Transport Stream for 

packets may experience a variable delay during multiplexing 40 output or presentation at the reception site. The PCR's 

since the multiplexer can only send one packet at a time. carried in the Transport Packets of a single selected program 

When a PCR bearing Transport Packet experiences a vari- can be used to slave the decoder's system clock to the 

able delay, the original PCR in that packet is no longer valid. encoder's system clock for purposes of decoding that pro- 

Consequently, the Transport Stream multiplexer 22 must gram. That is, the PCRs can be used to recreate or 

adjust the original PCR to account for any variable delay 45 re-establish the timebase of that single program as the 

imposed on that packet by the multiplexer. Note, however, Transport Packets carrying the elementary stream data for 

that constant end-to-end delays will not invalidate the PCRs that program arrive at the decoder. Stated generally, the 

in a series of Transport Packets since each Transport Packet PCRs may be used to perform clock recovery in the decoder, 

wfll experience that same constant delay. FIG. 3 illustrates a model decoder for use in selecting a 

One way to adjust the PCR value in a packet that 50 given program for output at a reception site. In accordance 

experiences a variable delay, and the method ultimately with the timestamp technique described above, a clock 

adopted by the ISO, is to determine the amount of variable generation circuit 58 in the decoder processes the PCR 

delay the packet experiences between the input and output of values carried in the Transport Packets of a selected program 

a multiplexer or other device, and then to add mat delay time in order to re-establish the timebase of the selected program 

to the original PCR value as the packet leaves the device in 55 for decoding purposes. According to the model, an MPEG2 

the outgoing Transport Stream. As a result of this Transport Stream is received by the decoder 40 and provided 

adjustment, the PCR's of a given program, no matter where to a Transport Stream demultiplexer/parsing unit 42. A 

they may appear in an outgoing Transport Stream, should user's program selection is provided to the de-multiplexer 

reflect the absolute value of the encoder's system clock at 42 via line 44. When a user selects a given program for 

the time the packets bearing those PCR's were inserted into 60 output, the de-multiplexer 42 begins extracting every incom- 

the outgoing Transport Stream. ing Transport Packet having a PID that matches one of the 

FIG. 2 illustrates the need for adjusting PCR values to PTDs assigned to the elementary streams that make-up the 

account for variable delays, such as multiplexing delays. As selected program. For example, referring back to FIG. 1, a 

illustrated in FIG. 2, two Transport Packet sequences, each subscriber may select "Program 1" which consists of 

formed from a different Packetized Elementary Stream, are « elementary streams "Video 1" and "Audio 1." Transport 

provided to respective inputs of a Transport Stream multi- Packets carrying the Packetized Elementary Stream data for 

plexer 22. One sequence of Transport Packets, eg. packets "Video 1" each have a FID of "10," and the Transport 
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Backets carrying the Packctized Blcmentary Stream data for network transmission systems that incorporate packet 

"Audio 1" each have a PID of "23." As successive packets multiplexing, such as ATM, would tend to change the 

of the Transport Stream are received, the de-multiplexer 42 temporal location of the Transport Stream packets in relation 

wfll extract every incoming Transport Packet having a PID to their PCRs. In other words, Transport Packets flowing 

of "10" or "23." Extracted Transport Packets will then be 5 through such switches will arrive at their destination "iit- 

parsed in order to reassemble the original Packetized tered" with respect to their PCRs. A packet is "jittered" when 

H^entary Streams. TJltanately, the coded video and audio ^ packet has had a temporal shift with respect to other 

data of eachPacketizedme^ntaiy Stream wm be provided ^ the same stream or with respect toits timing 

EWJ7t l 7 ,fa ? ^ *** ^l 0 reSpeC&Ve d ? coders information. In the MPEG-2 context, a "jittered" Transport 

50, 56 which decode the data to produce analog video and 10 Packet fa one that has experienced some variable delay wflh 

audio signals for output to a display device. respect to another packet in the Transport Stream or with 

Additionally, as each Transport Packet of the selected respect to its PCR, such that the PCRs no longer accurately 

program is received, the de-multiplexer 42 determines reflect me timebase of a Program, 

whether that Transport Packet contains a PCR. If so. the . . ,. . , . , . . 

r*-*> • JZL. TZ \i "r"" . " ^ r~ As Apphcants have recognized, in systems that introduce 

PCR is extracted from the incoming packet and provided to 13 H(t _ t *Z T „„ 0 ^ f c ^°~~~^. ,„ '. m .„ „ ~\ . „ 

the clock generation circuit 58vS line 59. As explained J1 "? * the l Trans P < f Stream packets, there is a need for a 

above, it is 8 highly unlikely that the frequency of a deEs jSl^^S^SZll^ S 

system ctockSffl be exactfy the same as that of the original £lT^T n Tnt^^™LT^ rfJ^L 

encoder, or that the decoder's system dock wfll be iwrS before those packets are presented to a decoder, 

stable (Le, wfll not drift). In ac^ce Se tir^S M Apphcants reviewed all current* available systems for 

approach described herein, the PCR values, whicharesent r«^gJ^in ^commumcahons systems andcon- 

periodically in the Transport Packets of the selected dndBd ** ?° P^yfv^ble tehrique could correctly 

^ 7 *u iiau^wii tflWktu U1 U1C fitl ™ remove the jitter from the Transport Stream packets, 

program, can be used to reproduce or recover the encoder _ . J J ^ p 

system clock in the decoder, Le., the PCRs can be used to ° ne P 101 m system of removing jitter, which Applicants 

re-establish the timebase of the selected program. Recovery « have found to te unsuccessful in the MPEG-2 context, 

of the encoder system clock in the decoder is performed by employs a technique of monitoring buffer fullness. Accord- 

a clock generation circuit 58. FIG. 3 illustrates a model clock m 8 to technique, packets are placed in a buffer and 

generation circuit that may be used in accordance with the ou * ut from me buffer at a rate designed to keep the buffer 

timestamp technique described above. fullness constant By setting the buffer fullness to a prede- 

The model clock generation circuit 58 of FIG. 3 imple- 30 S^^jT^ c" 1 *^ output rate to maintain 

ments a digital closed-loop control that is sirmlarto a ^ess of the buffer at that level, the clock of a transmission 

phase-lock-loop except that the reference and feedback ^ stem 18 M %*^ n tndad a Ttcc P*°* .system, 

terms are numbers (e.g., the values of counter 66 and P™**' such buffo- fullness techniques are effective only 

received PCRs). Upon initial acquisition of a user selected transmission bit rate systems where the data 

program, the counter 66 is loaded via line 61 with the first 35 ***** «* delivered from the transmission site to the recep- 

PCR received for that program. Thereafter, the clock gen- ? 0D ate * ^constant rate. In a variable bit rate system, the 

eration circuit essentially operates as a closed loop. A fata cannot be assumed to be delivered to the reception site 

voltage controlled oscillator (VCO) 64 having a nominal from * e .transmission site at a constant rate. In a variable 

frequency substantially equal to that of the encoder system tiansm^hitnte "J*™- sudl as an MPEG-2 system, the 

dock provides the decoder system clock signal As the 40 ^ffer fullness will change when the transmission bit rate 

decoder system clock runs, the clock sigiialkcrements mus ' me buffer fuUness technique fails in such 

counter 66 which therefore represents the absolute time of a 

the decoder system clock. As shown, the value of counter 66 Thus* there is a need for methods and apparatus for 
is continuously fed back to a subtracter unit 60. Subtracter removing jitter from packet streams, such as an MPEG-2 
60 compares the counter value with subsequent PCRs as 45 Transport Stream, in systems that include variable bit rate 
they arrive in the Transport Stream Packets. Since a PCR, transmission. The present invention satisfies mis need, 
when it arrives, represents the expected value of the decoder qttmmary hp tttp TMvrasrrrniM 
system dock at the time that PCR is received, the difference SUMMARY OF THE INVENTION 
between it and the value of counter 66 may be used to drive The present invention is particularly well suited for use in 
the instantaneous frequency of the VCO 64 to either slow 50 systems that transmit packets of information from a trans- 
down or speed up the decoder dock signal, as arjpropriate. mission site to a reception site wherein timestamp values are 
A low-pass filter and gain stage (LPF) 62 is applied to the inserted into selected packets prior to transmission in order 
difference values from the subtracter 60 to produce a smooth to facilitate dock recovery at a reception site, and wherein 
control signal for the VCO 64. As can be appreciated, the the timestamp values in each packet may require adjustment 
continuous feedback provided by counter 66 and the peri- 55 to compensate for variable delays (Le., jitter) experienced 
odic arrival of PCR values in the Transport Stream will during multiplexing and/or transmission before reception at 
ensure that the decoder system dock remains slaved to the a reception site. Such systems include, for example, those 
encoder system dock. Thus, for the sdected program, the that operate in accordance with the MPEG-2 Systems Sped- 
encoder system dock has been reproduced or recovered in fication. 

the decoder, i.e., the original timebase of the single sdected «j According to a preferred embodiment of the present 

program has been re-established. invention, the method comprises several steps. First, the 

Applicants have realized that although the PCRs of each packets are received at an intermediate site prior to reception 

program must be adjusted during packet multiplexing to at their ultimate destination. Second, the received packets 

compensate for packet delays, some network devices that are stored in a buffer at the mtermediate site. Third, the 

packets encounter during transmission will not institute the 65 packets are output from the buffer at a controlled rate for 

method described above to adjust the packets for variable reception at the ultimate reception site. Simultaneously, the 

delay. For example, Applicants have concluded that standard output rate of the packets is controlled by keeping a measure 
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of the transit time of packets through the buffer and adjusting packets when die packets arrived at the intermediate site, 

the output rate so that the average transit time of packets Prior to entering a jitter introducing network, the timestamps 

through the buffer remains substantially constant in a stream accurately reflect the temporal location of those 

According to the presently preferred embodiment, the packets within the stream relative to the clock at the site 

measure of transit time through the buffer is accomplished 5 from which they were transmitted. According to the present 

by obtaining an indication of the Hmp. the packet entered the invention, the calculated timestamps that are placed in the 

buffer; obtaining an indication of the time the packet is packets output from the buffer are compared to the original 

output from the buffer; and, subtracting the entry time from timestamps of each packet, respectively. The difference 

the output time. While the time of an individual packet between the calculated and original timestamps represents 

through the buffer may vary, a goal of the invention is to 10 40 error m lnc output rate. The output rate is adjusted to 

ensure that the average time of packet transit through the minimize this error. Thus, by continuously checking the 

buffer remains constant Accordingly, the individual packet calculated timestamps against the original timestamps, the 

transit times are filtered to remove short-term variations, and intermediate site more closely tracks the pre-jitter transmis- 

the output rate of packets from the buffer is adjusted to keep s t° n stream. 

the average transit time constant An apparatus according to 13 Additional features and advantages of the present inven- 

the present invention, which implements the foregoing tion will become evident hereinafter. 

method, is referred to herein as a dejitter device. ^« ™™ _ 4 „„^ T ^„ 

A ' L _ , ^ _ BRIEF DESCRIPTION OF THE DRAWINGS 
According to another aspect of the present invention, the 

packets contain timestamps that have been corrupted as a The foregoing summary, as well as the following detailed 

result of the packets experiencing jitter, and which must 20 description of the preferred embodiment, is better under- 

therefore be corrected to accurately reflect the temporal stood when read in conjunction with the appended drawings. 

location of the packets after dejittering is performed. This For the purpose of illustrating the invention, there is shown 

correction comprises the steps of: receiving the packets at an in the drawings an embodiment that is presently preferred, 

intermediate site before reception at the ultimate destination; it being understood, however, mat the invention is not 

storing the packets in a buffer at the intermediate site; 25 limited to the specific methods and instrumentalities dis- 

obtaining an indication of the nominal transmission bit rate closed. In the drawings: 

of the packets; outputting the packets from the buffer ini- PEG. 1 illustrates the generation of a Transport Stream 

tially at the nominal transmission bit rate for reception at the from a plurality of Packetized Elementary Streams in an 

reception site; measuring the transit time of packets through encoder; 

the buffer; determining a ratio a of transmission site clock 30 FIG. 2 illustrates the concept of timestamp adjustment to 

frequency to a local (ie., intermediate site) clock frequency account for multiplexing delays in a packet-based commu- 

for correcting local clock values to the transmission site nications system; 

clock values; modifying the timestamps contained in the piG. 3 is a block diagram of an exemplary decoder for 

packets using the local clock corrected by a; and, simulta- recovering a selected program from an incommg Transport 

neously controlling the output rate so that the average transit Stream; 

time through the buffer remains constant FIG. 4 illustrates an MPEG-2 system with a jitter intrc- 

According to the presently preferred embodiment, the during network in the transmission path and a dejitter device 

steps of determining the ratio a of the transmission site j n me transmission path in accordance with the present 

clock frequency to the local clock frequency comprises the ^ invention- 

steps of : initialing with the ratio a to a predetermined FI G . 5 illustrates a block diagram of the flow of data and 

value; Storing the average transit times of packets trough control in the dejitter device of FIG. 4 in accordance with the 

the buffer to produce an indication of the relative difference present invention. 

between the transmission site clock and the local clock and ■ _ . „ . . - L . . 

adjusting the ratio based on that relative difference. By M 6 iUustrates ft, ^ cUonal 1117151011 ofthe *&*au* 

keeping aratio a that tracks the relative frequency difference 45 process on a per sesaon basis. 

between the transmission site clock and the local clock, the 7 graphically depicts the relative drift of the encoder 

local clock can remain free-iunning with respect to the clock and a reception site clock over time and its effect on 

transmission site clock. Thereafter, local clock values at the temporal location of packets. 

intermediate site can lock to the transmission site clock by ^ FIG. 8 graphically depicts the variable rate changes 

multiplying intermediate site clock values by a. This experienced by packets during the pre-jittered stage and its 

technique, as opposed to physically adjusting the local clock effect on the temporal location of packets, 

frequency to lock to the transmission site clock, allows a FIG. 9 graphically depicts the effect of jitter on the 

single intermediate site local clock to track multiple trans- perception of transmission rate and its effect on the temporal 

mission site clocks. J3 location of packets. 

According to another aspect of the preferred embodiment, FIG. 10 graphically compares the pre-jittered variable 

the timestamps in the packets output from the intermediate transmission rate to the post dejittered variable transmission 

site are corrected based on the local clock. Specifically, as rate. 

the packets are output, the first timestamp of a given FIG. 11 presents a flow chart of the process of dejittering 

program remains unaffected; however, subsequent time ^ packets. 

stamps are changed by adding the time between the output FIG. 12 presents a flow chart of the process of replacing 

of the last packet and the time of output of the current me timestamps in selected packets, 

packet; correcting the resulting time by the ratio a; and 

adding that corrected resulting time to the previously output DETAILED DESCRIPTION OF THE 

packet's timestamp. PREFERRED EMBODIMENT 

Another aspect of the present invention adjusts the output Referring now to the drawings, FIG. 2 depicts Transport 

rate to track the timestamps that were in the stream of Streams travelling through a multiplexer 22 wherein they are 
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combined into a single Transport Stream. As explained 7, and will essentially drift around 27 MHz, the nominal 

above, in order to provide accurate timebase recovery during frequency of MFEG-2 system clocks. Because the receiving 

reception of a transmitted program, the PCR values carried device can measure the frequency of its own clock, if the 

in the Transport Packets must be adjusted at every multi- actual frequency of the encoder clock 117a including the 

plexing stage in the transmission system to compensate far 5 drift variation is tracked by the receiving dock, the packets 

any multiplexing delays imposed by a multiplexer. When- can be adjusted for a and the distance between the packets 

ever a multiplexing stage or other device that adheres to the will once again appear constant One technique for remov- 

MPEG-2 standard imposes a variable delay on the Transport ing a is by using the digital closed loop circuitry illustrated 

Packet, a value representing the magnitude of the delay is in FIG. 3, and described above. Such a device works well 

added to the current value in the PCR segment Each 10 when the receiving device can adjust its own frequency to 

multiplexing stage or other device will have a local system match that of the encoder clock 117a. However, such a 

clock operating at a nominal frequency of 27.0 MHz, the device cannot work when a multitude of encoder clocks 

nominal frequency of the encoder's clock 117. The delay, U7a, 1T7&, 117c must all be tracked simultaneously by a 

AT M , imposed upon the Transport Packet at a given multi- single reception device clock because each clock will have 

plexing stage or other device may be calculated as follows: 15 its own a relative to the reception device clock. 

Another factor, other than a, contributes to a perceived 

AT^cLSCRXwH^CRCTfchD transmission rate variation by a reception device. Multiplex- 

wnere ers encountered along the transmission path introduce vari- 

A , i , ^ ', , able delay. One such multiplexer 22 is illustrated in FIG. 4. 

LSCR(t c J is the value of the local system clock of the M ^ n3a mb m ^ ^ me 

multiplexer when the Transport Packet reaches the multiplexer 22 along with Transport Packets from encoders 

output of the multiplexer; neb n6c md so on ^ me packets ^ mb n3c 

I-SCR^ is the value of the local system clock when the 113J emerge from the multiplexer 22, the distance between 

Transport Packet enters the multiplexer; and each packet may have temporally shifted relative to their 

D is a pre-c^termined constant delay mat is imposed on all 25 pre-multiplexed temporal relationship. As illustrated in FIG. 

Transport Packets as they pass through the multiplexer. 4, Transport Packets from other encoders 1166, 116c will be 

Once calculated, the measured delay, AT Mj may be added to interleaved with the encoder 116a packets. For example, two 

the current value of the PCR segment additional packets have been inserted between packet 113 a 

As Applicants have recognized, Transport Streams may and packet 1136, and one additional packet has been inserted 

travel through networks that implement a transmission stan- 30 between packet 113c and packet 113*1 As illustrated in FIG. 

dard different from the MPEG-2 standard. In these networks 8, to a receiving device it will appear as though the packets 

the Transport Packets may experience multiplexing that were transmitted at a variable transmission bit rate. In the 

causes the packets to experience variable delay. However, example of encoder 116a, the packets 113a, 113b, 113c, 

because the transmission standard does not comply with the 113d appear to vary around 1 Mbit/second. However, 

MPEG-2 standard, the PCRs within those Transport Packets 35 through properly adjusted PCRs, a receiving device can 

wiQ remain uncorrected for the variable delay. When the track the transmission bit rate changes and reconstruct the 

packets emerge from such a network they may be temporally timebase of the program. As will be explained more fully 

shifted relative to the PCR values inserted by the encoder below, the PCRs contain the information necessary to recon- 

clock 117, Le., the packets may be jittered struct the rate as illustrated in FIG. 8. 

This jittering of the Transport Packets is illustrated by 40 When a jitter introducing network 112 is introduced to the 

following the Transport Packets through a typical travel system between the encoder 116a and the decoder 114, the 

path. FIG. 4 shows an exemplary multiplexed packet based temporal relationship between packets will be affected. As 

communication system in which the present invention may illustrated in FIG. 9, to a reception device this jitter will 

be employed. The system of FIG. 4 operates in accordance again appear to vary the transmission rate. This jitter pre- 

with the MPEG-2 Systems standard. However, the present 45 seats a problem in that the jitter introducing network 112 

invention is by no means limited thereto. does not adjust the PCRs in the packets to reflect the changes 

As illustrated in FIG. 4, a plurality of encoders 116 each in temporal location of the packets, and therefore, the PCR 

generate a series of Transport Packets containing the values are no longer valid. If this jitter is uncorrected and is 

elementary streams of a given program in accordance with outside of the constraints of the decoder 114, the program 

the MPEG-2 Systems Specification. Using the output from 50 cannot be recovered. 

encoder U6a as a typical example, the Transport Packets Accordingly, the present invention substantially removes 
U3a, 113k 113c, 113d* leave encoder 116a destined for the the jitter from the packets and then adjusts the PCRs to 
decoder 114 at a constant transmission bit rate of, for accurately reflect the temporal location of packets after jitter 
example, 1 Mbit/second. For simplicity, only PCR bearing is removed. The present invention inserts a dejitter device 
packets are shown, it being understood that many packets in 55 110 at an mtermediate site, between the jitter introducing 
a stream may not carry timestamps. Ideally, the distance network 112 and the decoder 114, to accomplish this goal of 
between the packets 113 is constant and the PCR bearing removing jitter from the packets and adjusting the times- 
packets accurately reflect the timebase of the program tamps before the packet reach the decoder 114. Specifically, 
generated by encoder 116a However, the encoder system the dejitter device 110 attempts to restore the packets to the 
clock 117a from which the encoder 116a derives its timing 60 approximate pre-jitter introducing network 112 temporal 
will drift due to a variety of factors. As a result of mat drift, relationship. For example, the pattern at which the encoder 
there will remain small fluctuations in the relative distances 116a packets entered the jitter introducing network 112 
between packets. Moreover, if the dock on the device should be reestablished as nearly as possible. FIG. 10 
receiving the packets is free-running, that clock will have its illustrates an example of the transmission bit rate of the 
own drift If uncorrected, the two clocks drifting relative to 65 packets as they exit the dejitter device 110 versus the 
one another will be perceived as small rate variations to the transmission bit rate of the packets before they enter the 
receiving device. This relative drift is labelled as a on FIG. jitter introducing network 112. As shown, the post dejitter 
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transmission bit rate will closely track the pre-jitter trans- In order for the dejitter device 110 to track the various 

mission bit rate. However, there will remain a small error, e, sessions, the dejitter device 110 is provisioned with infar- 

between the two transmission rates. As will be described in Elation. This provisioning information communicates to the 

detail below, the present invention tracks e to constantly dejitter device 110 which group of FIDs should be treated 

adjust the resulting output transmission bit rate in order to 5 together as a single session and what the nominal transmis- 

minimize e. sion bit rate is for a given session. Referring to the program 

Accordingly, the dejitter device U0 accepts jittered pack- examples of FIG. 1, the dejitter device 110 is provided with 

ets and outputs dejittered packets. Specifically, the dejitter information that allows it to associate FIDs "88,""107," and 

device 110 receives a Transport Stream from the jitter "56" to a single session, which in this example represents 

introducing network 112; tracks the drift, a, of the encoder to "Program 21.'* This provisioning information is kept in a 

clocks 117 to provide a jitter-free local clock reference; table of valid PIDs. Thereafter, as a Transport Packet is 

filters the jitter through a low-pass filter to remove it; outputs received, the dejitter device 110 examines the packet PID, 

the packets to track the pre-jitter introducing network trans- determines the appropriate session for the packet, and stores 

mission bit rate; and corrects the transmission bit rate for that packet together with other packets mat have PIDs 

error e in transmission bit rate. As a result, the packets output 15 belonging to the same session. Moreover, mis provisioning 

from the dejitter device U0 should approximate the packets information also communicates to the dejitter device 110 a 

as they entered the jitter introducing network HZ However, nominal transmission bit rate for each session. Thus, for 

the packets experience de-multiplexing and re-multiplexing example, the dejitter device 110 is provisioned with the 

within the dejitter device HO. As a result, the order of information that the Transport Packets comprising "Program 

packets exiting the dejitter device 110 may change. For 20 21" will be transmitted at a nominal transmission bit rate of 

example, as illustrated in FIG. 4, as the packets exit the 1 Mbit/second. As will be described more fully below, the 

dejitter device HO, one packet has been inserted between nominal transmission bit rate for a session is used to 

113& and 113c; whereas, prior to entering the jitter intro- initialize a rate cell 130 for mat session, 

during network 112 no packets came between them. Referring now to FIG. 5, the dejitter device HO of the 

However, the packets now accurately reflect the correct 25 present invention comprises eight functional blocks. First, 

temporal relationship to other packets in the stream and such input control logic 120 receives the packets. Second, a buffer 

minor discrepancies, as illustrated, will not affect the opera- 122, implemented in DRAM, stores the packets. Third, 

tion of the decoder 114. output control logic 124 outputs packets from the buffer 122 

As can be appreciated from FIGS. 1 and 4, a single at a controlled rate and re-multiplexes the Transport Packets 

Transport Stream is a multiplexed combination of Transport 30 of each program to form a new Transport Stream, Fourth, 

Packets representing a variety of programs, each potentially rate cells 130 control the rate at which packets are output 

generated by a different encoder 116. Typically, each from the buffer. The rate cells 130 are a group of registers, 

encoder U6 will employ its own system clock 117 that is one for each session, mat continuously count down from the 

used to establish the timebase of programs generated by that value loaded into the register. When a rate cell 130 reaches 

encoder. Although each encoder system clock 117 is nomi- 35 its terminal count a connection number is passed to the 

nally running at 27.0 MHz, each will still experience some Linked List Management Processor 128. Fifth and Sixth, 

drift relative to the clocks 117 of the other encoders 116. two processors, Rate Control Processor (RCP) 126 and 

Therefore, because the dejitter device HO modifies the Linked list Management Processor (LLMP) 128, control 

PCRs in the Transport Packets, and the PCR of a particular the buffer storage and implement the dejitter method of the 

packet must be set relative to the clock 117 of the encoder 40 present invention. The RCP 126 and LLMP 128 functions 

U6 that generated the data within that packet, the dejitter can be implemented in any suitable microprocessors, 

device 110 of the present invention must be able to track the According to the presently preferred embodiment, both the 

clock of each encoder 116a, 1166, 116c separately. RCP 126 and the LLMP 128 utilize an Advanced Micro 

Moreover, each encoder H6 may have a different transmis- Devices 29030 RISC processor running at 25 MHz. Seventh, 

sion bit rate. For example, while encoder U6a may transmit 45 a dual port RAM 127 positioned between the RCP 126 and 

at a transmission bit rate of 1 Mbit/second, encoder 116b the LLMP 128 allow the two processors to communicate 

may transmit at 2 Mbit/second. The dejitter device 110 must such information as nominal transmission bit rate and valid 

therefore separately track the transmission bit rates of each FTD numbers for a session. And eighth, a local clock 132 

encoder 116. provides a local clock reference for the dejitter device 110. 

Referring to FIG. 6, the present invention achieves these 50 The internal operation of the dejitter device U0 will now 

goals by essentially de-multiplexing the Transport Stream be described in further detail with reference to FIG. 5. 

into constituent sessions which represent all of the program Initially, the dejitter device HO receives, at the input control 

information transmitted from a particular encoder U6 logic 120, Transport Packets from a single Transport Stream, 

related to a single program. When the Transport Stream is Input control logic 120 interfaces the dejitter device to the 

received by the dejitter device HO, the different sessions are 55 transmission medium that handles low-level timing and 

de-multiplexed at point 121; the dejittering is performed and control while assembling packets in a first-in first-out fash- 

PCR adjustments are made on each session individually; the ion. After the input control logic has assembled a complete 

sessions are then re-multiplexed at point 123 as they exit the packet, it notifies the LLMP 128. Subsequently, the LLMP 

dejitter device HO. The dejitter device U0 has a single local 120 looks at the PID of the packet and compares the packet 

clock 132 that is used as a reference for each session. 60 to a table of valid PID values. This table contains the PID 

Because the dejitter device 110 has a single clock 132, the values of all valid sessions and is part of the provisioning 

MPEG-2 standard clock locking mechanism of FIG. 3 information supplied to the dejitter device 110, as described 

cannot be used. Rather, as will be described in detail below, above. If the PID value of the received packet is contained 

the dejitter device 110 tracks the a of each encoder H6 and in the table, that PID is considered valid, and the method of 

maintains an a for each session individually. The a for each 65 the present invention proceeds. 

session is then used as a coefficient to correct calculations After the FID is validated, the LLMP 120 stores the 

involving the local clock 132 for that session. packet in a buffer 122 by linking the packet, in a conven- 
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tional linked list, with a list of other received packets of the continuously adjusting the value set into the rate cell 130, 

same session. As each received packet is linked to its which, as explained above, controls the rate at which the 

respective session, the LLMP 120 maintains, along with the packets of a given session are output from the buffer, 

packet, other information needed by downstream processes. Output control logic 124 consists of an interface to the 

For example, the time the packet entered the buffer 122 is 5 transmission medium that also handles low-level timing and 

stored along with the packet Additionally, when the packet control Before a packet is output by control logic 124, the 

contains a PCR, the LLMP 120 also stores, along with the RCP 126 provides the output control logic 124 with a 

packet, a count of the number of packets in the Transport modified PCR in accordance with another aspect of the 

Stream that were received between this packet and the most P* 886 * ^5*?°!? mQr J^J^°^ 0 "* ut 

recent previous PCR bearing packet with the same HD. 10 T^V^S ^J^wlT^ m t pkCC ° f ^ 

that should be stored will be discarded because* taS ™ u \ aI * 0U s£ «re stared (ie., 

. " ^ tT b , lmked) on a per session basis, when keeping track of the 

aent buffer space. If the buffer underflows, not enough PCRs, a per FID basis is used That is, retain* back to the 

packets will have been stored. Consequently, packets will 15 example of "Program 21," only the "Video 21" packets 

not be output when they are due because the buffer is empty. contain PCRs. Neither the "Audio 21" nor the "Close 

Moreover, the MPEG-2 Systems Specification requires that Caption 21** packets contain PCRs. Thus, although the PCRs 

PCRs be sent every 100 ms. Because at least two packets are contained only in a single PID stream, they are related 

with PCRs must be stored to allow for proper timing of to the clock of the encoder 117 for all packets of that same 

output in accordance with the present invention, the 100 ms 20 session and, as will be explained more fully below, will be 

time between PCR packets must be accounted for in sizing useful in dejittering all packets of the same session. After 

the buffer. A minimum buffer size for each session can thus packets are linked in sessions, the dejitter device 110 effec- 

be determined by: tively operates on each session independently to correct the 

jitter. When the individual sessions are dejittered, the session 

Buffd^^Dday^+ioo ms)^ 25 streams are output from the buffer 122 and re-multiplexed to 

h create a new Transport Stream, 

w m ' According to me present invention, in order to dejitter the 

Delay*, is the worst case transit time mat a packet may packets of a particular session, the packets need to be output 

experience in travelling from the encoder 116 through from the dejitter device 110 at substantially the same trans- 

the network to the dejitter device 110 durmg transmis- 30 mission bitrate at which they were generated by the encoder 

sion. This value must be (ktermined empirically; 116 as modified by the pre-jitter multiplexer 122. Moreover, 

r^ is the maximum nominal transmission bit rate of the encoder clocks 117 drift relative to the dejitter device 

packets. local clock 132, Le., by an amount represented by a, as 

Multiplying by the number of sessions gives an approxima- illustrated in FIG. 7. In order to ensure accurate output of the 

tion of the overall minimum buffer size. Size efficiencies can as packets from the dejitter device 110, a must be estimated 

be gained by dynamically reallocating buffer space between and the dejitter device local clock 132 must closely track, 

Iowa and higher rate sessions. i.e., be locked to the encoder clock 117. This is accom- 

The RCP 126, in cooperation with the rate cells 130, plished in the present invention by passing the packets 

controls the output rate of packets from the buffer 122. To through buffer 122 and controlling their output so that the 

achieve this control, the RCP 126 initially sets the rate cell 40 transit time of each packet of the session through the buffer 

130 for a given session to the nominal transmission bit rate remains substantially constant By controlling the rate at 

that was provisioned to the dejitter device 110. Thereafter, which packets are output from the buffer, such that the 

the RCP 126 continuously adjust the value set into the rate average transit time of packets through the buffer remains 

cell 130 to track a and & The rate cell 130 then repeatedly substantially constant, jitter is effectively removed, 

counts down to a terminal count based on its set value 45 As mentioned above, the present invention uses a because 

provided by the RCP 126. Each time a rate cell 130 for a a single session cannot lock the frequency of the clock, but 

particular session reaches its terminal count, it notifies the rather, the clock must be shared among a plurality of 

LLMP 120 that a packet is due to be output When notified sessions. In the present embodiment, the dejitter device 110 

that a packet is due to be output, the LLMP 120 places a contains a single local clock 132. Therefore, the rate of mis 

packet into output control logic 124, which adjusts the PCRs 50 local clock 132 cannot itself be changed to track a single 

in the selected packets that contain PCRs and ensures that encoder clock 117; otherwise, the dejitter device local clock 

the packet is properly output. As the rate cells 130 notify the 132 would lock to the clock of one encoder 116 but remain 

LLMP 120, and the LLMP 120 places the packets in output unlocked with respect to the clocks of other encoders 116. 

control logic 124 in the order of notification from the rate Rather, the dejitter device 10 tracks the clock of each 

cells 130, the packets from all sessions are essentially 55 encoder 117 through a separate rate cell 130 and a separate 

re-multiplexed as a single Transport Stream. clock coefficient, a, while leaving the dejitter device local 

As noted above, the RCP 126 subsequently adjusts the clock 132 free-running with respect to all the clocks of all 

output rates to compensate for differences between the local encoders 116. In particular, the dejitter device 110 assumes 

clock 132 and the encoder 116 clocks, Le., adjusts the output that each session was created by a different encoder 116 and 

rate based on an a The local clock 132 provides clocking 60 tracks the encoders 116 on a per-session basis. The coeffi- 

information to all the subcomponents of the dejitter device dent a is updated in real time to track the relative drift 

110 at the nominal frequency of 27.0 MHz. Differences between the dejitter device local clock 132 and the clock of 

between an encoder clock 117 and the local clock 132 will each encoder 117; whereas, the rate cell 130 is used to track 

be reflected in packet transit time through the buffer 122. For the output rate of packets from multiplexer 22 for packets of 

example, if the local clock 132 is slower than the encoder 65 a given session. 

clock 117 then the packet transit times through the buffer Considering a particular session, the encoder 116 that 

will increase. This clock difference can be ininimized by created the packets of that session and the dejitter device 110 
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both have clocks running at substantially the same nominal LPF is a digital low pass filter function (for example, a 
frequency. However, mere will inevitably be a small varia- simple one-pole HR low pass filter), and the ATs are 

tion in frequency between the two clocks that must be filtered over a range from k to n. 

factored into the dejittering process of the present invention. This filter output can then be used to adjust a. In the 
This small variation is determined through oc As indicated 5 presently preferred embodiment, a is calculated by: 
above, a represents the ratio of the frequency of the dejitter -uokhat -at 

device local clock 132 to the frequency of the encoder clock «• ■■*) 

117. Alternately, a can be expressed as a ratio of encoder where, 

clock 117 ticks to the dejitter device local clock 132 ticks G is a gain function determined to provide stability, which 
relative to some point in time and can be represented In 10 can be determined empirically, 
equation form by: As will be described in detail below, a will be used as a 

multiplier to put the dejitter clock 132 in terms of the 
a - f« K * d " encoder clock 117. But, before discussing the various uses of 

~ fata* a, control of the output rate via rate cell 130 must be 

„ 15 introduced and described because the output rate and a are 

functionally interrelated. 

t irts w BMfer The packets stored in the buffer 122 must be output 

tebfyiatr through output control logic 124. To control the outputting 

of packets, the RCP 126 must determine the rate at which 
Ideally, the encoder clock 117 and the dejitter clock 132 are 20 packets for a given session should be output Hie dejitter 
identical and perfectly stable. Thus, a should be very close device 110 treats each session as if the rate is independent of 
to one. However, due to a variety of factors, the two clocks each other session. For example, the rate for packets asso- 
wfll drift relative to one another and this drift must be ciated with 4, Program 1" may be faster or slower than the 
tracked by a in real time. rate for packets associated with "Program 21." For example, 

There may be an equivalent variety of available methods 25 "Program 1" may be transmitted at the nominal rate of 1 
to compute a in real time. The presently preferred ernbodi- Mbit/second; whereas, **Rrogram 21" may be transmitted at 
ment tracks a by tracking the average transit time of packets 2 Mbit/second, or vice-versa. As a result, the RCP 126 must 
through buffer 122. More specifically, as each packet is track a plurality of output rates. This is accomplished, 
stored in buffer 122, the value of the dejitter device local according to the presently preferred embodiment, by the use 
clock 132 is stored. When the same packet is output from 30 of a group of rate cells 130. Each session is given a separate 
buffer 122, the value of the dejitter device local clock 132 is cell in the group of rate cells 30 that is set with a count for 
again stored. Using these clock count values, a time through that session's rate. These rate cells 130 continuously count 
the buffer can be determined for the nth packet according to: down and subsequently notify the RCP 126 that a packet 

should be output for that session. Hence, the rate cells 130 
ATjXxzm^ j-DCRit^ay „) 35 j^iixst be initialized with a rate for each session. 

wnere According to the presently preferred embodiment, the 

, — ,« » (»„ , t ^ s initial session rate is provided as a part of the provisioning 

^H"^ V f? ° f * e clock ^ ^ ^ ^ fh J^ im rate reflects the 

when the nth packet was output from the buffer, nomina l traiisinission bit rate from the encoder 116 and 

DCRCWry !>=The value of the dejitter clock at the time 40 cannot be relied upon to remain constant for a given session, 
when the nth packet was stored in the buffer. More likely, the rate will vary as the packets experience 

These transit times through the buffer can then be used to variable delays through multiplexing stages, such as at 
calculate a. The calculation assumes that the encoder clock multiplexer 22. Moreover, the rate may contain a small error 
117 and the dejitter device local clock 132 are nearly representing the differences between the encoder clock 117 
identical, so that the ratio between them should be very close 45 and the dejitter device local clock 13Z As discussed above, 
to one. Any difference between the two clocks will show up the dejitter device local clock 132 cannot be locked to any 
as a change in the average transit time through the buffer. If one encoder clock 117, but rather must remain free-running, 
the dejitter device local clock 132 is faster than the encoder Because of the free-running nature of the dejitter device 
clock 117 then the average transit time through the buffer local clock 132, the output rate from the buffer 122 will not 
will decrease as the dejitter device 110 empties buffer 122 50 be identical to the output rate from the encoder 116. Over a 
faster than the encoder 116 can fill it Alternately, if the period of time the output rate from the buffer 122 will be a 
dejitter device local clock 132 is slower than the encoder few ticks faster or slower than desired. This error will show 
clock 117, then the average transit time through the buffer up in the transit times through the buffer and will be reflected 
122 will begin increasing as the encoder 116 fills the buffer in a According to the present invention, the values in the 
122 faster man the dejitter device 110 can empty it Hence, 55 rate cells 130 are periodically adjusted to account for mis 
a can be adjusted by monitoring the average transit times error. 

through the buffer 122, i.e., the average of ATs. To determine Additionally, as the packets pass through the jitter intro- 
the average transit time of packets through the buffer, the ducing network 112, the PCRs become corrupted relative to 
ATs must be filtered to remove shorMerm variations. That is, the temporal location of packets. The PCRs must be modi- 
because the packets are jittered, the transit time through the eo fied to refer to a clock that is free of jitter. The dejitter device 
buffer will vary slightly from packet to packet Since the local clock 132 is used for this purpose. As each packet is 
variation is due to jitter, the system should not change in output from the buffer 122, the PCR is modified to reflect the 
response to these variations. Hie average AT after the nth dejitter clock 131 Initially, the first packet with a PCR that 
packet can then be determined by: ^ output from the dejitter device 110 for a session is not 

at;,. b =lpf(at at^. AT£ 65 modified - ™s PCR becomes a "seed PCR" for all subsc- 

* a n-i, qu&A PCR bearing packets. Subsequent PCR bearing pack- 

where, ets in that session are adjusted relative to the seed PCR based 
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on the local clock 132. Because the seed PCR bearing packet of packets from the dejitter device 110 does not exactly track 

is not changed, its modified PCR (MPCR) is equal to its the pre-jitter rate, as illustrated in FIG. 10. That error is 

original PCR. However, all subsequent PCRs must be modi- represented by the equation: 

fied to reflect the new temporal relation with respect to the €=mpcr--pcr. 

previous PCR bearing packet, which relation results from 5 

the dejittering process. Thus, for a given PCR bearing Taking this error into account yields: 
packet, the PCR must be stamped to be equal to the PCR of 

the previous packet plus the time that elapsed from when clock tjcka= ^ J>c ^"^ c ^-^" g 

that previous PCR bearing packet left the dejitter device 110 ***** 

and the time the present packet leaves. Because the time 10 

between packet PCRs (now MPCRs) must be in terms of the This new calculated clock tick value is loaded into the rate 

clock of the encoder 116, the times must additionally be cell 130. Packets are subsequently output at the new rate, 

corrected by a. In equation form, this MPCR calculation is which more closely tracks the pre-jitter transmission bit rate, 

represented as: This rate must be continuously adjusted to track the pre-jitter 

\±xfDs*D 15 ti^snrissKm bit rate because mat rate is a variable bit rate 

MPCR^DCRit^ ,d-DCR{t*x* ^y+MPCR^ that continuously changes as illustrated in FIG. 8. This 

where, continuous adjustment assures mat the error between the 

DCR(t,, J is the value of the dejitter device local dock MPCRs and the original PCRs in the Transport Stream is 

132 at the time the nth PCR bearing packet was output fiiiinized. Significantly, the MPCR is corrected bya. ^And 

from buffer 122 20 the rate error e is equal to the MPCR minus the PCR. Thus 

132 at the time the n-lth PCR bearing packet was *7 ^* „ J^l , , iVTI^T, 7,7 

outout from th buffer 122 the rate cell 130, clocked by the free-running local clock 

™ j-a • *u nrn C • *u- *u * 1 ^ compensated for a. This a compensation works to 

quently thedejitter device 110, is correctly reflected by the nQ u js fl<)w ^ masta&i ^ ^ < _ ion ^ me 

PCRs. Additionally, the use of a ensures that the modified , . „ . fm i ^uZuZ.^, „/T„ ^, ^ 

PCRs track the clock 117 of the encoder 116 that initially ^ ^1°^ embo ^ nt °[ the n ^ tho ? «f 

^atedth uv uuu. xmuoujr p[esajl[ mvenbolL First, at step 1000, a stream of packets 

^ccording^ a further aspect of the present invention, 30 is "T""' 3 ' * e *H"? U °" A™**** to * e 

,7_~7*. a. .TT . i F , . , ^ presently preferred embodiment of the present invention, the 

small errors m the output rate of packets of a given session „„ . ,„ ' *~. . f „ „ . „ ^„ _",„,, 

/.a« k* k,,1^.^„^;„-. ^r~~ ,, fi „j%v-T>„ packets received conform to the MPEG-2 Systems standard, 

can be minimized by comparing the modified PCRs to fte (pcfo) reflecting the value of the 

^ f^i°, fT^. 3 !!^^ 6 transmission system (Le. encoder) docfc Moreover, the 

output rate accordingly. A"nn»fcated m FIG. 8, the dejnter 3J ^ Pm s indicating the packets that together 

device 110 attempts to outprt packets as near as possible to ^ « ^ mc m 

the pre-jitter transmission bit rate. The transmssion bit rate ^ mumsxed ^ sessions . As discussed above, each 

which was initially provisioned into the rate cell 130, should „J£^jT^ n JjZ, TnZZ J^m^j^rJ^Z J.„i£» 

. j . . . _ . . . ^ „„ session is defined by a group or FIDs. The packets havmg 

be continuously adjusted to output packets at &epre-jtoer ^ Qf a ^ ^Vaored in the buffer 122 with 

variable transmission to rate as lUustrated m FIG. 8. This ^ otherp ^^ mtr ^ seKio ^ Asindictedbv!!tepl()<kl ,the 

adjusted tnnamssxm bit rate can be determined by calcu- ^Hre men on a basis as the 

lating the number of dock ticks between PCRs as: remaining steps are performed substantially simultaneously 

pcr. - POUi for each session. Thus, the steps discussed below apply to all 

ciocktfckii= sessions. 

' octo * 45 At step 1007, to prevent buffer underflow, the dejitter 

process must wait for the buffer for this session to begin to 

Moreover, because the outgoing packets are free of jitter, the fiuto some portion of its capacity (eg., 50 percent). When 

number of clock ticks between the modified PCRs in the me buffer has filled to me desired level, men, at step 1008, 

outgoing session packets should be identical to the number the rate ceU 130 for a given session is loaded with an output 

of clock ticks between PCRs in the original Transport 50 rate vawe> in the first iteration, the output rate is set to a 

Stream. However, the dejitter clock 132, used to clock the nominal value that is provided to the dejitter device 110 (step 

rate cells 130, on the dejitter device 110 is not precisely 1006). This nomiiialtraiumis^ 

locked to the encoder clock 117. As a result, the packets will the rate cell 130 at step 1008. Next, at step 1010, the packets 

be output from the buffer 122 at a slightly different rate than of me seS sion at the rate indicated by the value in the rate ceU 

the pre-jitter rate. This rate difference will show up in the 35 130. That is, each time the rate cell 130 counts down from 

number of clock ticks between successive packet exit times, ^ loaded ^ ^ register, it signals the LLMP 128 to 

t^ If the dejitter device local clock 132 were locked to the output a paclcet foe buffer. As indicated in step 1012, 

encoder clock 117 then the number of clock ticks between ^ packets pass through the buffer, the transit time of each 

packets would also be equivalent to: packet through the buffer is measured This measurement is 

60 obtained by taking two snapshots of the local dock 132 

o\Dekr^dks=DCRXt^ j-DCR(t ) value, once when a packet enters the buffer, and again when 

~* the packet exits the buffer. The transit time of a packet 

where, through the buffer is obtained by subtracting its entrance 

DCR^t^j) represents the count of the dejitter clock 132 time from its exit time. As indicated by step 1014, the 

when the packet exited the buffer. 65 measured transit times of packets through the buffer are used 

But, the clocks are not locked, and thus mere is a small error to determine a ratio, a, of encoder clock 117 frequency 

e between the PCRs and DCRSft^. As a result, the output relative to local clock 132 frequency. As described in detail 
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above, a is a function of the average transit times of packets 
through the buffo; and is used to adjust the output rate of 
packets from the buffer so as to maintain a substantially 
constant average transit time of packets through the buffer. 

Next, in step 1016, a modified PGR (MPCR) replaces the 
original PGR in PCR bearing packets. The MPCR (step 
1018) is a function of the local clock 132 corrected by a and 
is described in detail above. The MPCR is an adjustment to 
the original PCR in a packet to reflect any changes in the 
temporal relationship of that packet to a preceding PCR 
bearing packet that results from the controlled output of 
packets through the buffer. 

Represented by step 1020, the packets are output from the 
dejitter device 110 and a new stream of dejittered packets is 
formed. As indicated in step 1018 and as described more 
fully above, the output rate is adjusted as a function of a and 
an error difference, e, between the original PCRs of each 
packet and the MPCRs that are inserted into the packets as 
they exit the buffer. The new rate is then loaded into the rate 
cell 130 and the process loops continuously until all packets 
have been dejittered. 

FIG. 12, is a flow chart illustrating further details of step 
1016 of FIG. 11, ie., the process of modifying the PCRs in 
the PCR bearing packets. As noted by step 1030, this PCR 
modification process is performed on a per session basis. 
Initially, at steps 1032 and 1034, an exit value is obtained far 
the first PCR bearing packet that leaves the buffer. This value 
becomes exito- Because the first PCR bearing packet 
becomes the seed for planting new PCRs in all the subse- 
quent PCR bearing packets, the MPCR for mis packet 
remains unchanged from the original PCR value. 
Consequently, MPCRq is equal to PCRg. 

As indicated by step 1036, the following steps 1038 
through 1044 are performed on all subsequent PCR bearing 
packets. First, at step 1038, an exit value, exit n , is obtained 
for the nth PCR bearing packet as it exits the buffer. Second, 
at step 1040, an MPCR is determined for this nth packet 
according to MPCR n =MPCR /fr _ 1 -Kx*(exit n -exit n _ 1 )- For 
example, the second PCR bearing packet has a MPCR equal 
to MPCRo plus a multiplied by the difference between the 
time the packet was output from the buffer and the time 
when the first packet was output The MPCR of a packet 
reflects the time that packet exited from the buffer relative to 
the time mat the previous packet exited from the buffer. At 
step 1042, the original PCR of the packet is replaced by the 
MPCR The packet is then output at step 1044. The process 
loops back to step 1036 and begins again for each subse- 
quent PCR bearing packet 

Thus, in accordance with the above described methods 
and apparatus of the present invention, the overall result of 
the dejitter device 110 is to restore the Transport Stream as 
closely as possible to its condition prior to entering the jitter 
introducing network 112. Some jitter may nevertheless 
remain; however, mis remaining jitter is accommodated by 
modifying the original timestamps to reflect the remaining 
jitter. 

As the foregoing illustrates, the present invention is 
directed to a method and apparatus for dejitterlng packets 
that have encountered uncorrected variable delay or jitter. Ik 
is understood, however, that changes may be made to the 
embodiments described above without departing from the 
broad inventive concepts thereof. Accordingly, this inven- 
tion is not limited to the particular embodiments disclosed, 
but is intended to cover all modifications that are within the 
scope and spirit of the invention as defined by the appended 
claims. 



What is claimed is: 

1. In a system for transmitting packets of information 
from a transmission site to a reception site at a transmission 
bit rate, wherein timestamp values are inserted into selected 
packets prior to transmission that represent the value of a 
transmission site clock, and further wherein the packets 
experience jitter during transmission, a method of substan- 
tially removing jitter and adjusting the timestamp values 
prior to reception at the reception site, said method com- 
prising the steps of: 

(a) receiving the packets at an intermediate site having a 
local clock that operates at a nominal frequency sub- 
stantially equal to the nominal frequency of the trans- 
mission site clock; 

(b) storing the received packets in a buffer at said inter- 
mediate site; 

(c) outputting the packets from said buffer at an initial 
nominal rate for reception at the reception site; 

(d) measuring an average transit time of packets through 
said buffer; 

(e) adjusting said rate at which packets are output from the 
buffer to maintain a substantially constant average 
transit time of packets through the buffer; and, 

(f) modifying the timestamps of said selected packets to 
reflect changes in temporal relationship between pack- 
ets due to said adjusted rate of output thereof. 

2. The method of claim 1 further comprising the steps of: 

(i) after the step of receiving the packets at an interme- 
diate site, de-multiplexing the packets into separate 
groups of packets, each said separate group defining a 
session; 

(ii) perforating steps (b) through (f) on the packets of each 
session independently, the packets being output from 
said buffer in a re-multiplexed form, 

3. The method of claim 1 wherein the step of adjusting the 
rate at which packets are output from the buffer comprises 
the steps of: 

(i) low-pass filtering values representing the average 
transit times of successive packets through the buffer to 
produce a measure of the ratio of local clock frequency 
to transmission site clock frequency that is free from 
jitter; 

(ii) determining a value a based on said low pass filtering 
of the average transit time of successive packets 
through said buffer, which represents the ratio of the 
frequency of the transmission site clock to the fre- 
quency of said local clock; and, 

(ii) periodically adjusting the output rate based on a. 

4. The method of claim 3 wherein the step of determining 
the value a further comprises the steps of: 

initializing a to a predetermined value substantially equal 
to the ratio of the nominal frequency of the transmis- 
sion site clock to the nominal frequency of the local 
clock; and, 

periodically adjusting a based on changes in the low-pass 
filtered values. 

5. The method of claim 3 further comprising the step of 
adjusting the output rate based on the timestamps contained 

60 in said selected packets when said packets were received at 
the intermediate site. 

6. The method of claim 1 wherein the step of modifying 
the timestamps of said selected packets comprises the steps 
of: 

(i) setting the value of a first modified timestamp to the 
timestamp value contained in a first packet containing 
a timestamp; 
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(11) recording a first value of said local clock, DCR^t^, 
when the first packet containing a timestamp is output 
from said buffer, 

(iii) recording a second value of said local clock, DO^ 

when the second packet containing a timestamp 5 
to be modified is output from said buffer, 

(iv) calculating a second modified timestamp; wherein 
said second modified timestamp is equal to the first 
modified timestamp ^*(VCR^t e ^VCR l (t^)\ 

(v) after calculating said second modified timestamp, 
replacing the value of the timestamp in said second 
packet with the value of said second modified times- 
tamp; 

(vi) setting the value of said first modified timestamp to is 
the value of said second modified timestamp and said 
first value of said local clock to said second value of 
said local clock, DCR^W,); and, 

(vii) repeating steps (iii) to (vi) for all subsequent packets 
containing a timestamp. 20 

7. The method of claim 6 further comprising the step of 
periodically further adjusting the rate at which packets are 
output from said buffer based on a comparison of the value 
of the timestamp in said second packet to the value of said 
second modified timestamp as steps (iii) to (vi) are repeated 25 
for subsequent packets. 

8. In a system for transmitting packets of information 
from a transmission site to a reception site at a transmission 
bit rate, wherein timestamp values are inserted into selected 
packets prior to transmission that represent the value of a 30 
transmission site clock, and further wherein the packet may 
experience jitter during transmission, ah apparatus for sub- 
stantially removing packet jitter and adjusting packet times- 
tamp values to synchronize the reception site clock to the 
transmission site clock, said apparatus comprising: 35 

a local clock; 

means for receiving the packets; 

a buffer for storing the received packets; 

means for outputting the packets from said buffer at an 40 
initial transmission bit rate for reception at the recep- 
tion site; 
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means cooperating with said local clock for measuring 
average transit times of packets through said buffer, 

means cooperating with said means for measuring transit 
times for adjusting the rate at which packets are output 
from said buffer to maintain a substantially constant 
average transit time of packets through the buffer; and, 

means for modifying the timestamps of said selected 
packets to reflect changes in temporal relationship 
between packets due to said adjusted rate of output 
thereof. 

9. An apparatus as in claim 8 wherein the means for 
adjusting the output rate comprises: 

filter means cooperating with said buffer for filtering a 
plurality of average transit times of packets through the 
buffer, and, 

a processor cooperating with said filter means adding 
successive values emerging from said digital filter 
means; multiplying the added values by a gain factor to 
produce a signal representing the ratio of local clock 
frequency to transmission site clock frequency; and, 
adjusting the output rate based on said signal so that the 
average time of packets through said buffer remains 
substantially constant 

10. The apparatus of claim 8 wherein the means for 
outputting the packets comprises: 

a rate cell cooperatiiig with said local clock that is loaded 
with a value representing the rate at which packets 
should be output from said buffer, said rate cell con- 
tinuously counting down from said loaded value to zero 
and providing a signal that a packet should be output 
from said buffer each time a zero count is reached; 

a processor responsive to the signal from said rate cell for 
outputting a packet from said buffer when the rate cell 
provides the signal that it has reached zero; and, 

output control logic that communicates with said proces- 
sor for outputting a packet to the reception site. 

* * * * * 
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